Off-equilibrium confined dynamics in a glassy system with level-crossing states 



Barbara Capone,^ Tommaso Castellani,^ Irene Giardina/'^ and Federico Ricci-Tersenghi^ 

^ Dipartimento di Fisica, CNR-INFM (UdR Roma I and SMC center), 
Universitd di Roma "La Sapienza" , P. Aide Moro 2, 1-00185 Roma, Italy 
'^ISC-CNR, Via del Taurini 19, 1-00185 Roma, Italy 

We study analytically the dynamics of a generalized p-spin model, starting with a thermalized 
initial condition. The model presents birth and death of states, hence the dynamics (even starting 
at equilibrium) may go out of equilibrium when the temperature is varied. We give a full description 
of this constrained out of equilibrium behavior and we clarify the connection to the thermodynamics 
\^ ' by computing (sub-dominant) TAP states, constrained to the starting equilibrium configuration. 
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^ \ Many interesting physical systems live for very long times out of equilibrium, and, in this regime, they display 
/— \ ■ highly non trivial behaviors which are still to be understood (e.g. rejuvenation and memory effects in spin glasses). 

' In general, these systems fall out of equilibrium when some external parameter is changed. For example, fragile glass- 
lO forming liquids undergo a dramatic slowing down of their relaxational dynamics when the temperature is dropped 
^""^ ■ below the glass transition temperature^. This effect is sharpened in certain mean-field models where, at a critical 
■ temperature T^, a transition occurs from an equilibrium kind of dynamics to an off-equilibrium aging oneS.. The 
(~| ' phenomenon is ubiquitous and can be found also in very different fields: e.g. in local search algorithms for solving 
P5 \ hard optimization problems the time-complexity may become extremely large by varying a macroscopic parameter—. 
' A better understanding of the mechanisms leading to the dramatic slowing down in out of equilibrium dynamics is a 
• ^ ] subject of broad interest and wide applicability. 

In describing the dynamical slowing down (and possible eventual arrest) the common view suggests that at a low 
temperature a huge number of metastable states appears (with energies higher than the equilibrium one, Eq), making 
relaxation to equilibrium very slow, and even impossible if interactions are long ranged and metastable states life- 
times diverge in the thermodynamic limit. This picture has been verified by solving the out of equilibrium Langevin 
'"^ , dynamics of a particularly simple mean-field model, the so-called fully connected spherical p-spin, whose Hamiltonian 
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H{a} = - V J,,....,a.,...a.^ , (1) 
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^ where the N spins <Ti are continuous variables subject to the spherical constraint = N and the couplings are i.i.d. 

On random variables with zero mean and variance p\ /(2iVP-i). In this model (hereafter p > 3) if we consider a quench, 
^ that is if we choose an initial configuration of high energy and let the system relax at a fixed value of the temperature 
T <Td {Td being the dynamic transition temperature), the asymptotic dynamics remains trapped at the energy level 
of the highest and most numerous metastable states, the so-called threshold states. Time-translation invariance and 
the dynamic fluctuation-dissipation relation are violated and aging is observed in correlation and response functions^. 
\ These features are intriguing and experimentally relevant, since aging behaviour has been observed in many disor- 
"Y^ ■ dered systems. Nevertheless, in order to compare with more realistic situations it is extremely useful to understand 
' the dynamical behaviour during a cooling. In this case the system relaxes while the temperature is slowly decreased 
^ , from an initial high value to a final temperature below Td. 

I , ' In the single-p-spin model, defined by the Hamiltonian ([T]), changing the temperature during the dynamics has no 
effect on the asymptotic states approached by the relaxing systen*^. This can be easily understood by considering 
the structure of metastable states. Thanks to a particular symmetry, at any temperature T < Td the ordering (in 
free-energy) of the metastable states is the same they have (in energy) at zero temperature^. As a consequence 
the metastable threshold states, those where the out of equilibrium dynamics converges to, are the same at any 
temperature below Td. However, for this very reason, the single-p-spin model can be considered as pathological. 
In more realistic systems, when the temperature (or any other external parameter) varies, metastable states may 
$-H appear/disappear and their ordering is no longer preserved. For such systems, many questions on the dynamical 
behaviour are still open: for example, it is not clear what is the asymptotic state of the off-equilibrium dynamics if 
the temperature varies during the relaxation and whether such asymptotic state can be computed directly from the 
thermodynamical measure (i.e. statically), without solving the dynamical equations. In this paper we try to give some 
answers to the above points. 

A last comment on the relevance of the present work concerns the difference between a cooling and a quench. 
The common experience (exploited by the Simulated Annealing method) tells us that, in the same amount of finite 



time, the cooling is able to reach lower energies than the quench. But what happens in the large times limit? In 
the single-p-spin model the answer is simple: any cooling scheme, included the quench, converges to threshold states, 
which are T-independent. On the contrary, if threshold states vary with temperature, the answer was unclear and we 
show analytically that the asymptotic state may depend on the cooling scheme. The paper is organized as follows: 
Section |T] describes the model we want to study and summarizes what was already known about it; in Section |TT] 
we write and solve the equation for the out of equilibrium dynamics, starting from a thermalized configuration; in 
Section IIIII we report the results of the computation of the number of TAP states, constrained to a fixed distance 
from a reference state (more details are given in Appendix |X| and we compare these results with the solution of the 
dynamical equations; finally in Section [IVI we summarize our results and give some future perspective. 

I. THE MODEL 

We focus our attention on a modified version of the p-spin Hamiltonian, the so-called multi-p-spin model, in which 
spins do interact in r-uples with r taking more than one value: 

W{o:} = -^Cr ^ • • -f^ir 7 (2) 

r l<ii<...<i,.<N 

Using the overline for the disorder average, we have that 

n{a]n{T}^\Y.''r<f^f{q), (3) 

r 

where q = aiTi/N is the overlap among g_ and r. The single-p-spin corresponds to /(g) — 

The choice of the Hamiltonian ^ is motivated by the request of an exactly solvable dynamics, for which we need 
continuous variables interacting in a fully-connected fashion. Unlike the single-p-spin case, in the multi-p-spin model 
there is level crossing of metastable states by varying the temperature^. 

From a statical point of view, this model is characterized by the presence of a large number of metastable states 
Af{f) exp[iVI](/)]. The so-called complexity E is an increasing function of the free-energy / which is zero at the 
lower band edge /o and maximal for a certain value / — fmax ■ For high temperatures the Gibbs measure is dominated 
by the paramagnetic state (to^ = 0) , while for T < Td {T^ being the dynamical critical temperature) , metastable states 
start to play a relevant role, much in the same way as for the single-p-spin model. In this region the thermodynamic 
equilibrium is given by a class of metastable 'equilibrium' states with finite complexity (see e.g. Ref. ,9;), the global free 
energy of the system thus bearing a contribution from this state-related entropy, i.e. —TlnZ = F = f^q — T'E{feq). 
Lowering still more the temperature, the complexity of the equilibrium states decreases until a point where it becomes 
zero and the lower band edge states, non exponential in number, become dominant. The temperature where this 
occurs, Ts, is the static transition temperature for this model, as can be seen also by a direct computation of the 
partition function with the replica method. The interpretation of this transition as an 'entropy crisis' for metastable 
states is particularly relevant when comparing this model with real systems: indeed fragile glasses do exhibit in this 
respect a very similar phenomenology. 

The structure of metastable states can be investigated in much detail by considering the tap approach, where mean- 
field equations can be formulated for the local magnetizations rrii (at fixed disorder realization), and stable solutions 
of these equations identified as states of the system. Recently, some novel intriguing features of this formalism have 
emerged, according to which metastable states can either satisfy a supersymmetry between fermionic and bosonic 
integration variables^'', either break it^^. Supersymmetric (SS) states are very robust to external perturbations, while 
supersymmetry breaking ones (SSB) are extremely fragile, and even a small perturbation can dramatically change 
their number and global structure^^. Interestingly, the multi-p-spin model addressed in this paper, contrary to the 
single-p case, exhibits states of both classes^ and allows a comparative study of their role. In particular, states in the 
range [/o, fth] are SS, while states with / G [fth, fmax] are SSB. The free energy level fth separating the SS from the 
SSB region, that we shall call threshold energy, also plays a relevant role in the dynamical behaviour of this system. 

Another important feature of metastable states, which is more relevant for the questions we want to address, is 
their behaviour with changing the temperature. For the single-p-spin spherical model, as anticipated above, states 
can be transposed in temperature and their energy ordering does not change. There is no birth/death of states with 
varying the temperature, or, in other words, a tap solution at zero temperature persists when the temperature is 
turned on until T = Td. In the multi-p-spin model this is not the case. To investigate more explicitly this point, we 
need a method to 'pin' out a state and 'follow' it with varying the temperature. This can be done by resorting to a 
dynamical analysis. 



II. THE DYNAMICS 

Given the Hamiltonian ^ with a generic correlator f{q), it is possible to write the equations for the Langevin 
dynamics at temperature T = 1/13 as 

dt da, ^' 

where 77 (t) is a thermal Gaussian noise with zero mean and variance 

mriit'))^^Sit-t') . (5) 

Given the initial conditions this equation can be solved exactly using the method of the generating functionali^. 
Self-consistent equations for the correlation function C{t,t') = {ai{t)ai{t')) and the response function R{t,t') = 
d(7i{t) / dhi{t') read 

dC{t,t') 



dt 



-^i{t)C{t,t')+ [ dsf'[C{t,s)]R{t\s) + 
Jo 

dsR{t, s) f"[C{t, s)]C{s, t') + l3'f'[C{t, 0)]C{t',0) (6) 





-n{t)R{t,t') + [ dsf"[C{t,s)]R{t,s)R{s,t') (7) 



dR{t,t') 

dt 

where fi{t) is a Lagrange multiplier implementing the spherical constraint on the spins and obeys the dynamical 
equation 

/x(t) = /* dsf'[C{t, s)]R{t, s) + f dsR{t, s) f"[Cit, s)]Cis, t) + ^ + [3'f'[Cit, 0)]C{t, 0) (8) 
Jo Jo P 

The most studied case is the one where initial conditions are chosen at random (/?' — 0), and the system starts 
exploring the configuration space from a high energy configuration. In this context, for example, the first analytical 
complete treatment of aging behaviour has been carried out for the single-p-spin^ . 

From our point of view, however, the most interesting situation is another one. If we choose the initial condition 
a_{t = 0) to belong to a given metastable state, then we can let the system evolve and check whether the state is stable 
and well-defined (in which case we expect an equilibrium-like relaxation dynamics inside the state) or looses stability 
(exhibiting off-equilibrium behaviour). To this airoi^, we may choose an initial condition thermalized at temperature 
r = 1/(3', i.e. 

P{a.m = ^^^v[-P'n{a{m (9) 

Indeed, since for Tg < T' < Td the Boltzmann measure is dominated by a class of metastable states, the distribution 
^ naturally picks out a configuration a(0) which belongs to one of such states. Besides, since the class of dominating 
states varies with the temperature, we can use T' to select the kind of state (i.e. energy, complexity and self-overlap) 
we want the system to start in. 

Summarizing, the dynamics that we are considering, described by Eqs. (jHH]), involves two distinct temperatures. 
The first one, T, controls the thermal noise and therefore represents the temperature at which the dynamical evolution 
takes place. The second one, T' is used to force the system to start into a given metastable state, and to select its 
properties. We now analyze the dynamical behaviour of the system by tuning these two parameters. 



A. The quench 

The case = corresponds to random initial conditions, that is to a quench. In this case the system undergoes 
a dynamical transition at a critical temperature T = Td where the relaxation time diverges (much in the same way 
as in the single-p-spin) . For T < Td the dynamics exhibits aging and asymptotically reaches the threshold states. 



which have energy density Eth (corresponding to free 6iiergy density Jth) H-nd self-overla,p (lu^ — ^m? 

where qm{T) is 

the solution to the marginality condition 

nqm){l-qm?=T^ ■ (10) 

A similar behaviour occurs for any T' > T^. 

We note that the dynamics following a quench always converges to the edge of the SS region, despite a larger number 
of SSB states are present at higher energy densities {Eth < E < Emax)- At least two explanations are possible: (i) 
SSB states are "invisible" for the dynamics we have solved; (ii) SSB states are marginally unstable (they have a finite 
number of zero modes in the thermodynamic limit) and they are unable to trap the system during the relaxationJi. 

B. The case Ts < T' < Ta 

When Ts < T' < Td, the situation is more complex: as described above the thermodynamic equilibrium is no longer 
given by the paramagnetic state but rather by a set of metastable states with energy density E G [Eo,Eth]- Thus, 
the initial configuration belongs to one of such states. For T = T' the system undergoes an equilibrium dynamics in 
the state where it was at the starting time. For T < T' the initial condition is out of equilibrium and, according to 
the value of T, different dynamical behaviours can be observed. In particular, a critical temperature Tg_g(T') exists, 
such that: 

i) For Tiig{T') < T < T' < Td the system follows, at large times, an equilibrium relaxation dynamics. Eqs. © 
and ([7]) can be easily solved exploiting time-translational invariance and the fluctuation-dissipation relation between 
correlation and response. The asymptotic regime is then fully described by the two parameters 

qi= lim \im C{t,t') and p=limC(t,0), (11) 

(t — t')— tcxD i'^cxD i— too 

which turn out to be different from zerc"'^^, similarly to the single-p-spin model^. The physical interpretation is clear: 
the system has been prepared inside an equilibrium state at temperature T'; at temperature T this state still exists, 
even if with slightly different features, and the system dynamically relaxes into it. In this view, qi identifies the 
self-overlap of the state at temperature T, while p measures the overlap between the equilibrium state at T', where 
the initial configuration is placed, and the same state transposed at temperature T. 

ii) For T < Tg^g(T") < Td the dynamics remains out of equilibrium even for large times, showing aging and violation of 
the time-translation invariance. Equations for the correlation and the response functions can be written using the same 
scaling ansatz as the single-p-spin model-ii^. For asymptotic but close times [t' oo, t — t' = 0(1)], time translation 
invariance is recovered and the parameter qi can be defined as in Eq. pip . For asymptotic and well separated times 
[f oo, t/t' = 0(1)], the correlation function scales as C(t,t') = C(A), with A = t' /t G [0,1] and C(l) = qi 
(the same scaling holding for the response). This regime defines another asymptotic parameter go = limA^oC(A). 
In this temperature region, the asymptotic limit is fully described in terms of the three parameters qi, qa and p, 
together with the so-called fluctuation-dissipation ratio Xdyn = TR{t,t') / dt'C{t,t') measuring the violation of the 
fluctuation-dissipation relation. The explicit equations for these quantities read^^ 

/3V"(9i)(i-gi)' 
/3/'(gi)(l-9i)+ 

fix[q^nqi) - qof'{qo)]+P'pf{p) 

Pxp[r{q^)-f{qo)]+f3'f'{p) ^^^> 
(3f{qoKl~qi)+f3xf'{qo){qi-qo) 
+f3xqo[f{qi)-r{qo)]+P'pfip) 

The parameters qo, qi and p are plotted in Fig. [T]for f{q) = q'^/2 + (0.45)^g^/2 (the same correlator used in Ref. Is^. 
T' has been chosen very close to Td in order to have a large Tag value. 

The first of equations (fT^ coincides with the marginality condition obeyed by threshold states and defining q^ (T) . 
However, the asymptotic dynamical energy Edyn = limt^oo E!{t) that we obtain is different (and lower) from the 
threshold energy Eth, indicating that the asymptotic dynamics takes place in a marginal manifold below the threshold 
states one. This feature also holds when T' = Td, which is relevant for understanding the behaviour of a cooling in 
this system. Indeed an infinitely slow cooling is able to reach thermal equilibrium at any temperature above and 
at T,^: thus for temperatures T below Td an infinitely slow cooling is roughly equivalent to a dynamics starting 
thermalized at T' — Td- Our result then indicates that for this system the asymptotic states reached with a cooling 
are lower than those reached with a quench. Actually the difference between these asymptotic states is really very 
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FIG. 1: The dynamical parameters qi, qo and p (curves); the mutual overlap gi2 and the self-overlap obtained from the TAP 
complexity computation (points). Here f(q) — q"^ /2 + (0.45)'^g^/2. Relevant temperature values are: Td = 0.6543, T' = 0.653 
and Tag (0.653) = 0.527. Inset: difference between asymptotic energies in a quench and a cooling (see text). 

tiny (see inset of Fig. [T]). To our knowledge this is the first analytically solvable model showing up a dependence of 
the asymptotic dynamical states on the cooling schedule. 

Note also that the solution of Eqs. (fT^ has go 7^ 0. This means that the system never decorrelates completely. 
We are observing aging together with a strong dynamic ergodicity breaking, contrary to the weak-ergodicity breaking 
scenario analyzed for this kind of models so far^. As long as p > the initial condition is not forgotten by the aging 
system and thus the initial condition acts like a magnetic field, inducing go > 0. 

The change in the dynamical behavior at T = Tag can be better understood by noticing that qi > as long as 
T > Tag, and qi = qm for T < Tag. The simplest interpretation is that states dominating the Gibbs measure at T' 
are stable for T > Tag(T'), but at Tag(T') they become marginal, forming a manifold where the system ages on. For 
T < Tag(T') these states become unstable and the system keeps aging in a nearby critical manifold with qi = q^ and 
go < qi- 

This interpretation also tells us that in the multi-p-spin model, contrary to the single-p-spin, it is not possible 
to 'follow' any state from T = to finite temperature, or viceversa, because some states loose stability as the 
temperature is varied and there may be birth/death of states with temperature. Moreover, changing the temperature 
the complexity S varies along the dynamical trajectory, implying that there is mixing of states. The variation in S 
is very tiny: e.g. for f{q) = q^ /2 + [OAbYq^ /2 is 0(10^^ 10^^) and for this reason it would be hardly visible in a 
numerical simulationiS. 



III. THE CONSTRAINED COMPLEXITY 

To confirm the interpretation given above and to better understand the dynamical behaviour, we can look more in 
details at the structure of the metastable states in the region where the asymptotic dynamics occurs. In particular, 
we can consider the following static quantity. Given a reference state, that will be appropriately chosen as the state 
to which the initial configuration of the dynamics belongs, we compute the number of metastable states of given 
free energy density that have fixed mutual overlap with it. Using the index 1 for the reference state and 2 for the 
metastable states we wish to count, we compute N{qi2, /2I/1) exp[A^S(gi2, /2I/1)], that is the number of states of 





free energy density /2 that have mutual overlap qi2 with a reference state of free energy density /i . Temperatures are 
not written explicitly, but it is assumed that Ti = T' and T2 = T. 

This computation can be performed in the tap approacbii, where metastable states are identified with local 
minima of the mean-field energy functional -FtapIhi} = H{Tri} — 1/(2/3) log(l — g) — | (/(I) — .f{q) — (1 — q)f'{q)), 
where q = "^f • this case, the number of states reads 

A/'(gi2,/2|/i) = / ]J(dm'l'dmf'6{^,F■,^Am'''})S{^^F^ApW''})) Idet i7{m<^>}| |deti?{m<^'} 

6{F^.,,{m'''} - Nf,) 5{F^^Air'"'} ~ Nh) <5(to<^' • m<^' - Nq^^) x N{hr^ (13) 

In this expression the first two delta functions ensure that rn^^^ and m<^' are stationary points of Ftap, {F[ij{rn} = 
didjFTAp{m} being the Hessian in the appropriate normalization factor), and imply that we are looking at solutions 
of the mean-field equations (i.e. states). The other delta functions fix respectively the free energy densities and the 
mutual overlap of the solutions we wish to count. Note also that we have divided by the number of metastable states 
with free energy /i in order to get the number of states of free energy /2 with overlap 512 with a given reference state 
of kind 1 (otherwise we would have gotten the number of pairs). 

The entropy related to (jl3p . also called constrained complexity, can be computed using standard technique a^^i^^ 
within the annealed approximation, which is in general adequate to treat large free energies /i , /2 ~ fth (see Appendix 
EJ. Alternatively, the entropy can be computed as the Legendre transform of a constrained thermodynamic free 
energyi^i^S. The two results coincide within numerical precision. 

Let us now use this constrained entropy to investigate the structure of the phase space sampled by the asymptotic 
dynamics. To this end, let us fix /i = feqiP') and /2 = fdyn{0) = Edyn{P) — TS{Edyn)- That is, the reference state is 
chosen as the state where the dynamics has been started in (an equilibrium state at temperature T'), while the states 
to be counted have energy density equal to the asymptotic dynamical energy. The behaviour of S as a function of qi2 
is displayed in Fig. [21 We see that two different situations occur above and below Tag. 

For T > Tag(T') the constrained complexity is positive and decreasing with increasing 512, (as discussed for the 
single-p-spin in Ref . ITsh . it becomes negative at some value of the mutual overlap and touches back the zero axis for 
912 ~ P (see the lowest curve in the inset of Fig. [2]), with p given by the dynamical equations (|12p . The interpretation 



-0.72062 



O 



i:< 



E<0 



0.56 



0.62 



0.64 



0.58 0.6 

qi2 

FIG. 3: Constrained complexity in the (gi2, j-i) plane, with /i = feq{T' = 0.653) and T = 0.35 



is straightforward. For small overlaps we are counting states in a very large manifold, and we thus find many of them. 
As qi2 decreases, this manifold becomes smaller and, consequently, the number of counted states decreases until when 
it becomes zero (negative complexity). However, if we still increase the overlap, looking closer to the reference state, 
at some point we are bound to find the state itself. This is signaled by the zero value of the complexity at qi2 = p, 
which therefore represents the overlap between the reference state and the same state evolved at temperature T, 



consistently with the dynamical interpretation. In this point one also has g*' 



m 



(2) 



/N = qi, with qi given 



again by the dynamical equations. Please note that g'^' = qi is not the typical value for TAP states at temperature T 
and free-energy fdyn] so the dynamics is restricted to a set of sub-dominant states, that can be selected by constraining 
the TAP measure as in p^ . The interpretation is straightforward: the T' equilibrium state has evolved in a slightly 
modified state at temperature T, which has overlap p with the original one. This is the only state (i.e. S = 0) that 
we count at temperature T when fixing qi2 — p. Note that this state is stable (by computing the replicon) and it is 
"isolated", that is the S curve is negative in the (9121/2) plane around the point {p,fdyn)- 

For T < Tiig{T') the secondary peak of the constrained complexity becomes positive (see inset of Fig. [5]) and the 
E > region in the {qi2, /2) plane (with /i fixed) is shown in Fig. [31 The T' equilibrium state opens up at T = Tag(T') 
and a non trivial structure of metastable states appears close to where the dynamics is taking place; these states are 
responsible for the aging behavior, but it is still unclear which are the thermodynamical parameters of the dynamical 
asymptotic states. This is the main question when trying to describe the dynamical behavior in terms of static 
observations. 

We know that for T < Tag the dynamics is taking place on a marginal manifold, so we can fix g*^' — qm{T): states 
with this self-overlap are found along the full line in FigO All the points along this line are possible candidates for 
the asymptote of the dynamics, but understanding which one is actually chosen during system relaxation is a difficult 
task. 

Consistently with the dynamical computation the point (p, fdyn) is always on the line. Moreover, at this point, 

st — ^dyn 

holds, where Xst{qi2, f2) = TdfY,{qi2, f, /i)|/=/2 and Xdyn is the dynamical fluctuation-dissipation ratio. 
It seems that at least one dynamically computed quantity must be plugged in the static computation to predict the 
asymptotic states: this can be equivalently qi2 — p or Xst = Xdyn (for a quench the computation is easier: starting 
with a random configuration one has gi2 = by definition). It would be very useful to find an extremizing principle 
to select, among all the candidate tap states, those which are actually reached by the constrained out of equilibrium 
dynamics. 



IV. SUMMARY AND PERSPECTIVES 



The spherical muhi-p-spin model defined by the Hamiltonian ^ has the nice properties of being exactly solvable 
(thanks to its continuous variables), while showing non-trivial dependence on temperature of its states (birth, death 
and level crossing). These features makes the model more realistic than other mean-field models and a perfect 
candidate for studying glassy relaxation under variations of temperature. 

We have performed such a study finding several interesting analytical results, (i) The relaxation at any temperature 
converges to tap states satisfying the supersymmetry between fermionic and bosonic integration variables. In order 
to understand whether tap states breaking the supersymmetry are relevant for finite times dynamics, the method 
described in Ref. [2l| could be applied to the present model, (ii) Energies reached by a cooling are lower than those 
reached by a quench. This result is based on the assumption than an infinitely slow cooling equilibrates at any 
temperature T > T^, which needs to be improved, (iii) The solution to the dynamical equations is consistent with 
the constrained complexity of tap states computed thermodynamically: starting from a thermalized configuration 
and lowering the temperature, the system starts aging when the state it belongs to becomes marginally unstable. For 
lower temperatures, states where aging is taking place cannot be predicted solely from the constrained complexity; a 
new extremizing principle is needed in order to make the connection between static and dynamic computations. 
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Equations like (|12|l first appeared in Ref. uM. However, in that paper there was a mistake in one of such equations and the 
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Convergence to equilibrium at Ta is a subtle point: there are no 0{N) barriers (states are marginal), and so the equilibration 
time is less than exponential in N (we expect it to grow polynomially with N). 
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APPENDIX A: THE CONSTRAINED COMPLEXITY VIA THE TAP APPROACH 



Starting from Eq. (jl3p . the computation of the constrained complexity can be performed with standard techniques. 
The annealed computation is the simpler one, since it involves averaging directly the number of solutions over the 



quenched disorder, rather than its logarithm. Rephcas are therefore not needed. 

To proceed, we introduce bosonic representations for the deha functions appearing in Eq. p3p . and fermionic 
representations for the two determinants (the modulus can be safely disregarded for this model, since one can show 
that minima dominate over saddles in the relevant free energy density rang^S,). In this way, we get 

A/^(gi2,/2,/3|/i,/3') = ^(jf^,) ^ 1^ 2^ J (Al) 

with 

Sim, X, I, ±, u- f,P)^Y. 2^«5«^TAp(m, P)+Y. ^^^,^,F^^^{rn, /3)V'j + u{F^^^{m, (3) ~ Nf) , (A3) 

i ij 

and 

F,,p(™, (3) = H{m} - 1/(2/3) log(l - ?) - f [/(I) - /(-z) - (1 - 9)/'(<z)] , (A4) 
where x^^'"^") are the Lagrange multipliers enforcing the tap equations, ui^2 are those enforcing the free energy con- 

(1 2) ~(1 2) 

straint, w is the one for the mutual overlap constraint, and ip^ '' ' , ip ' are the Grassman variables used to represent 
the determinants. As usual, di is the shorthand notation for d/drm- 

After averaging over the disorder the numerator and the denominator of expression (IA1|) . consistently with the 
annealed approximation, site dependent variables can be integrated out, leaving an effective action which only depends 
on global variables: 



N= j D[n,uj,ui,U2,w]exp[NSeff{n,uj,ui,U2,w;qi2,f2,f3Ji,f3')-Ni:{h,P')] , (A5) 
where 17 = [gi, ^2, -Bi, -B2, i?2, -B12, -B21], defined by (a, 6 = 1, 2) 



Qa 


= (m<"' 


• m<''')/iV 




Ba 


= (m<"' 


•a;<"')/7V 




Ra 


- (f 


• V'*°')/iV 




Bab 


(m<"' 


■x^''^)/N 


(A6) 



and to = [Ai, A2, 61, 62, ri, r2, 612, ^21] are the corresponding Lagrange multipliers. 
The explitic expression for the effective action is the following: 

Seff = i logz - i logs + log(2/?'g'(<zi) + n) + \og{2f3g'{q2) + 

+ f3'u,igiq,) h) + /3«2(5(92) - /2) + ^(B? - Rl)f"{qi) + y (i?| - i?2')/"fe) ^^^^ 

+ ^W?/!?!) + Y"2/fe) + f3f3'B,2B2lf"{qi2) + PP'u^U2f{qi2) 

- riRi - r2i?2 - hBi - 62-B2 - &12-B12 - b2iB2i - >^iqi - \2q2 - wqi2 , 



with 



z = {m'inqi)fiq2)-i.nqi2m 

S = (hi - 2zAi)(?22 - 2ZA2) - (/12 - zwf 
giq) = -1/(2/3) log(l -q)-^ [/(I) - /(g) - (1 - g)/'(g)] , 



^11 = /3'/'(g2)rf?i - 2/3/37'(gi2)diirf2i + rf{qi)dl„ 

h2 = /3V(g2)rfllrfl2 - /3/37'(gi2)(rfllrf22 + rf2lrfl2) + /3''/' (^l )rf21 ^22 , 
/22 = /3^/'(g2)rf?2 - 2/3/37'(gi2)rfl2rf22 + /3''/' (^l )rf22 , 



dii = 2/3'^(gi) + 6i + /3'V/'(gi), 

= 6i2 + /3/3W(to), 
d2i =62i+/3/?V/'(gi2), 

d22 = 2pA{q2)+b2+P^U2f'{q2). 

The effective action (|A7|) has to be extremized with respect to aU the integration variables in order to obtain the 
constrained complexity as I](gi2, /2, f3, fi,l3') = S°ff{qi2, f2, P, /i, /?') - ^')- 



